Claims 



What is claimed is: 

1 . A system for capturing real-time video images from a musical instrument, said 
system comprising: 

a musical instrument comprising an instrument body and a performance area, wherein 
said performance area defines an area of said musical instrument where a user physically 
interacts with said musical instrument; 

a video camera attached to said instrument body to capture real-time video images of 
at least a portion of said musical instrument, wherein said video camera generates a video 
signal representing said real-time video images; and 

a video output interface providing said video signal to an external system. 

2. The system according to claim 1, wherein said external system comprises a 
video display visible to an audience. 

3. The system according to claim 1, wherein said video signal is processed by at 
least one real-time image processor, wherein said at least one real-time image processor is 
configured to generate an outgoing control signal responsive to said video signal. 

4. The system according to claim 3, wherein said outgoing control signal 
comprises a signal of MIDI format. 

5. The system according to claim 3, wherein said video signal is processed by at 
least one real-time image processor to generate a modified video signal, wherein said at least 
one real-time image processor is controlled by an incoming control signal. 

6. The system according to claim 5, wherein said musical instrument generates 
said incoming control signal in response to said user interaction with said musical instrument. 
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7. The system according to claim 5, wherein said incoming control signal is 
generated by a physical controller in response to user interaction with said physical controller. 

8. The system according to claim 5, wherein said incoming control signal 
comprises a signal of MIDI format. 

9. The system according to claim 1, wherein said video signal is recorded by a 
video recording system. 

10. The system according to claim 1, wherein said video camera is attached to 
said instrument body in such a location to capture said real-time video images from said 
performance area of said musical instrument. 

1 1 . The system according to claim 10, wherein said musical instrument comprises 
a string guitar, and wherein said performance area includes a bridge area of said string guitar. 

12. The system according to claim 10, wherein said musical instrument comprises 
a string guitar, and wherein said performance area includes a non-string area of said string 
guitar. 

13. A method for capturing real-time video images from a musical instrument, 
said method comprising: 

providing a musical instrument comprising an instrument body and a performance 
area, wherein said performance area defines an area of said musical instrument where a user 
physically interacts with said musical instrument; 

capturing real-time video images of at least a portion of said musical instrument 
using a video camera attached to said instrument body, wherein said video camera generates a 
video signal representing said real-time video images; and 

providing said video signal to an external system. 
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14. The method according to claim 13, wherein said external system comprises a 
video display visible to an audience. 

15. The method according to claim 13, wherein said video signal is processed by 
at least one real-time image processor, wherein said at least one real-time image processor is 
configured to generate an outgoing control signal responsive to said video signal. 

16. The method according to claim 15, wherein said outgoing control signal 
comprises a signal of MIDI format. 

1 7. The method according to claim 15, wherein said video signal is processed by 
at least one real-time image processor to generate a modified video signal, wherein said at 
least one real-time image processor is controlled by an incoming control signal. 

1 8. The method according to claim 1 7, wherein said musical instrument generates 
said incoming control signal in response to said user interaction with said musical instrument. 

1 9. The method according to claim 1 7, wherein said incoming control signal is 
generated by a physical controller in response to user interaction with said physical controller. 

20. The method according to claim 17, wherein said incoming control signal 
comprises a signal of MIDI format. 

21 . The method according to claim 13, wherein said video signal is recorded by a 
video recording system. 

22. The method according to claim 13, wherein said video camera is attached to 
said instrument body in such a location to capture said real-time video images from said 
performance area of said musical instrument. 
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23. The method according to claim 22, wherein said musical instrument comprises 
2 a string guitar, and wherein said performance area includes a bridge area of said string guitar. 

24. The method according to claim 22, wherein said musical instrument comprises 
2 a string guitar, and wherein said performance area includes a non-string area of said string 

guitar. 

25. A system for extracting and generating control signals from video signals, said 
2 system comprising: 

a first video signal decomposition element for receiving a first incoming video signal, 
4 wherein said first video signal decomposition element separates at least one image-related 

component from said first incoming video signal; and 
6 a processor for processing said at least one image-related component of said first 

incoming video signal according to a control signal extraction algorithm, wherein said 
8 processing results in an associated at least one outgoing control signal comprising a signal of 

MIDI format. 

26. The system according to claim 25, wherein said first incoming video signal 
2 originates from a video camera. 

27. The system according to claim 26, wherein said video camera is attached to a 
2 musical instrument. 

28. The system according to claim 26, wherein said incoming video signal is 
2 communicated to a video display visible to an audience. 

29. The system according to claim 25, wherein an incoming control signal is used 
2 by said control signal extraction algorithm to generate said at least one outgoing control 

signal. 
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30. The system according to claim 29, wherein said incoming control signal 
comprises signals of MIDI format. 

31 . The system according to claim 25, wherein said control signal extraction 
algorithm is selected from a plurality of pre-stored control signal extraction algorithms. 

32. The system according to claim 25, wherein said control signal extraction 
algorithm recognizes at least one pattern in said incoming video signal, wherein said at least 
one pattern is used to generate said at least one outgoing control signal. 

33. The system according to claim 32, wherein said control signal extraction 
algorithm further calculates at least one pattern parameter associated with said at least one 
pattern in said incoming video signal, wherein said pattern parameter is used to generate said 
at least one outgoing control signal. 

34. The system according to claim 32, wherein said control signal extraction 
algorithm further recognizes at least one gesture in said incoming video signal, wherein said 
recognition is used to generate said at least one outgoing control signal. 

35. The system according to claim 34, wherein said control signal extraction 
algorithm further calculates at least one gesture parameter associated with said at least one 
gesture recognized in said video input signal, wherein said gesture parameter is used to 
generate said at least one outgoing control signal. 
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36. The system according to claim 25, said system further comprising: 

a second video signal decomposition element for receiving a second incoming video 
signal, wherein said second video signal decomposition element separates at least one image- 
related component from said second incoming video signal, wherein 

said processor processes said at least one image-related component of said second 
incoming video signal according to said control signal extraction algorithm, wherein said 
processing of said at least one image-related component of said first incoming video signal 
and said at least one image-related component of said second incoming video signal results in 
said associated at least one outgoing control signal comprising a signal of MIDI format. 

37. The system according to claim 36, wherein said second incoming video signal 
originates from a video camera. 

38. The system according to claim 25, said system further comprising: 

a second video signal decomposition element for receiving a second incoming video 
signal, wherein said second video signal decomposition element separates at least one image- 
related component from said second incoming video signal, wherein 

said processing element processes said at least one image-related component of said 
second incoming video signal according to said control signal extraction algorithm resulting 
in a secondary at least one outgoing control signal comprising a signal of MIDI format. 

39. The system according to claim 36, wherein said control signal extraction 
algorithm recognizes at least one pattern in said second incoming video signal, wherein said 
at least one pattern is used to generate said at least one outgoing control signal. 

40. The system according to claim 39, wherein said control signal extraction 
algorithm further calculates at least one pattern parameter associated with said at least one 
pattern in said second incoming video signal, wherein said pattern parameter is used to 
generate said at least one outgoing control signal. 
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41 . The system according to claim 39, wherein said control signal extraction 
2 algorithm further recognizes at least one gesture in said second incoming video signal to 

generate said at least one outgoing control signal. 

42. The system according to claim 41, wherein said control signal extraction 

2 algorithm further calculates at least one gesture parameter associated with said at least one 

gesture recognized in said video input signal, wherein said gesture parameter is used to 
4 generate said at least one outgoing control signal 

43. The system according to claim 25, wherein said first incoming video signal is 
2 processed by a real-time image processor to generate a modified video signal, wherein said 

real-time image processor is controlled by an incoming control signal. 

44. A method for extracting and generating control signals from video signals, 
2 said method comprising: 

receiving a first incoming video signal at a first video signal decomposition element, 
4 wherein said first video signal decomposition element separates at least one image-related 

component from said first incoming video signal; and 
6 processing said at least one image-related component of said first incoming video 

signal according to a control signal extraction algorithm, wherein said processing results in 
8 an associated at least one outgoing control signal comprising a signal of MIDI format. 

45. The method according to claim 44, wherein said first incoming video signal 
2 originates from a video camera. 

46. The method according to claim 45, wherein said video camera is attached to a 
2 musical instrument. 

47. The method according to claim 45, wherein said incoming video signal is 
2 communicated to a video display visible to an audience. 
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48. The method according to claim 44, wherein an incoming control signal is used 
by said control signal extraction algorithm to generate said at least one outgoing control 
signal. 

49. The method according to claim 48, wherein said incoming control signal 
comprises signals of MIDI format. 

50. The method according to claim 44, wherein said control signal extraction 
algorithm is selected from a plurality of pre-stored control signal extraction algorithms. 

5 1 . The method according to claim 44, wherein said control signal extraction 
algorithm recognizes at least one pattern in said incoming video signal, wherein said at least 
one pattern is used to generate said at least one outgoing control signal. 

52. The method according to claim 51, wherein said control signal extraction 
algorithm further calculates at least one pattern parameter associated with said at least one 
pattern in said incoming video signal, wherein said pattern parameter is used to generate said 
at least one outgoing control signal. 

53. The method according to claim 51, wherein said control signal extraction 
algorithm further recognizes at least one gesture in said incoming video signal, wherein said 
recognition is used to generate said at least one outgoing control signal. 

54. The method according to claim 53, wherein said control signal extraction 
algorithm further calculates at least one gesture parameter associated with said at least one 
gesture recognized in said video input signal, wherein said gesture parameter is used to 
generate said at least one outgoing control signal. 
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55. The method according to claim 44, said method further comprising: 
receiving a second incoming video signal at a second video signal decomposition 

element, wherein said second video signal decomposition element separates at least one 
image-related component from said second incoming video signal; and 

processing said at least one image-related component of said second incoming video 
signal according to said control signal extraction algorithm, wherein said processing of said 
at least one image-related component of said first incoming video signal and said at least one 
image-related component of said second incoming video signal results in said associated at 
least one outgoing control signal comprising a signal of MIDI format. 

56. The method according to claim 55, wherein said second incoming video signal 
originates from a video camera. 

57. The method according to claim 44, said method further comprising: 
receiving a second incoming video signal at a second video signal decomposition 

element, wherein said second video signal decomposition element separates at least one 
image-related component from said second incoming video signal; and 

processing said at least one image-related component of said second incoming video 
signal according to said control signal extraction algorithm resulting in a secondary at least 
one outgoing control signal comprising a signal of MIDI format. 

58. The method according to claim 55, wherein said control signal extraction 
algorithm recognizes at least one pattern in said second incoming video signal, wherein said 
at least one pattern is used to generate said at least one outgoing control signal. 

59. The method according to claim 58, wherein said control signal extraction 
algorithm further calculates at least one pattern parameter associated with said at least one 
pattern in said second incoming video signal, wherein said pattern parameter is used to 
generate said at least one outgoing control signal. 
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60. The method according to claim 58, wherein said control signal extraction 
algorithm further recognizes at least one gesture in said second incoming video signal to 
generate said at least one outgoing control signal. 

61. The method according to claim 60, wherein said control signal extraction 
algorithm further calculates at least one gesture parameter associated with said at least one 
gesture recognized in said video input signal, wherein said gesture parameter is used to 
generate said at least one outgoing control signal. 

62. The method according to claim 44, wherein said first incoming video signal is 
processed by a real-time image processor to generate a modified video signal, wherein said 
real-time image processor is controlled by an incoming control signal. 

63. A real-time video signal generation system, said system comprising: 
an input interface for receiving incoming MIDI control signals; 

a memory unit for storing previously generated video data comprising real-time video 
images; and 

a processor for generating a video output signal comprising selectable portions of said 
previously generated video data, wherein said video output signal is generated according to a 
video generation algorithm that associates said incoming MIDI control signals with particular 
real-time video images of said stored video data. 

64. The system according to claim 63, wherein said video generation algorithm is 
selected from a plurality of pre-programmed video generation algorithms. 

65. The system according to claim 64, wherein an incoming control signal of 
MIDI format is used to select a particular video generation algorithm from said plurality of 
pre-programmed video generation algorithms. 
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66. The system according to claim 63, wherein said real-time video images 
2 comprise video stills. 



67. The system according to claim 63, wherein said real-time video images 
2 comprise video clips. 

68. The system according to claim 63, wherein said real-time video images 
2 comprise graphics animations. 

69. The system according to claim 63, wherein said real-time video images 
2 comprise a graphic rendering created from a numerical dynamic simulation. 

70. The system according to claim 63, wherein at least one graphics operation is 
2 introduced into said video output signal in response to said incoming MIDI control signals. 

71 . The system according to claim 70, wherein said graphics operation comprises 
2 a raster graphics operation. 

72. The system according to claim 70, wherein said graphics operation comprises 
2 a vector graphics operation. 

73. The system according to claim 70, wherein said graphics operation comprises 
2 a overlay graphics operation. 

74. The system according to claim 70, wherein said graphics operation comprises 
2 a text rendering operation. 
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75. A method for generating a real-time video signal, said method comprising: 
2 receiving incoming MIDI control signals; 

storing previously generated video data comprising real-time video images; and 
4 generating a video output signal comprising selectable portions of said previously 

generated video data, wherein said video output signal is generated according to a video 
6 generation algorithm that associates said incoming MIDI control signals with particular real- 
time video images of said stored video data. 

76. The method according to claim 75, wherein said video generation algorithm is 
2 selected from a plurality of pre-programmed video generation algorithms. 

77. The method according to claim 76, wherein an incoming control signal of 

2 MIDI format is used to select a particular video generation algorithm from said plurality of 
pre-programmed video generation algorithms. 

78. The method according to claim 75, wherein said real-time video images 
2 comprise video stills. 

79. The method according to claim 75, wherein said real-time video images 
2 comprise video clips. 

80. The method according to claim 75, wherein said real-time video images 
2 comprise graphics animations. 

81 . The method according to claim 75, wherein said real-time video images 
2 comprise a graphic rendering created from a numerical dynamic simulation. 

82. The method according to claim 75, wherein at least one graphics operation is 
2 introduced into said video output signal in response to said incoming MIDI control signals. 
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83. The method according to claim 82, wherein said graphics operation comprises 
2 a raster graphics operation. 

84. The method according to claim 82, wherein said graphics operation comprises 
2 a vector graphics operation. 

85. The method according to claim 82, wherein said graphics operation comprises 
2 a overlay graphics operation. 

86. The method according to claim 82, wherein said graphics operation comprises 
2 a text rendering operation. 

87. A real-time video signal generation system, said system comprising: 
2 an input interface for receiving incoming MIDI control signals; 

a video signal interface for receiving an incoming video signal; and 
4 a real-time video processor for generating a video output signal comprising a 

modified version of said incoming video signal, wherein said real-time video processor 
6 modifies said incoming video signal according to a video generation algorithm controlled by 

said incoming MIDI control signals. 

88. The system according to claim 87, wherein said video generation algorithm is 
2 selected from a plurality of pre-programmed video generation algorithms. 

89. The system according to claim 88, wherein an incoming control signal of 

2 MIDI format is used to select a particular video generation algorithm from said plurality of 
pre-programmed video generation algorithms. 

90. The system according to claim 87, wherein a video overlay operation is 
2 introduced into said video output signal. 
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91 . The system according to claim 87, wherein said real-time video processor 
2 generates said video output signal using a video wipe processing operation. 

92. The system according to claim 87, wherein said real-time video processor 
2 generates said video output signal using a video fade processing operation. 

93. The system according to claim 87, wherein said real-time video processor 
2 generates said video output signal using a video blend processing operation. 

94. The system according to claim 87, wherein said real-time video processor 
2 generates said video output signal using a video solarization processing operation. 

95. The system according to claim 87, wherein said real-time video processor 
2 generates said video output signal using a video geometric warping operation. 

96. A method for generating a real-time video signal, said method comprising: 
2 receiving incoming MIDI control signals; 

receiving an incoming video signal; and 
4 generating a video output signal comprising a modified version of said incoming 

video signal using a real-time video processor, wherein said real-time video processor 
6 modifies said incoming video signal according to a video generation algorithm controlled by 

said incoming MIDI control signals. 

97. The method according to claim 96, wherein said video generation algorithm is 
2 selected from a plurality of pre-programmed video generation algorithms. 

98. The method according to claim 97, wherein an incoming control signal of 

2 MIDI format is used to select a particular video generation algorithm from said plurality of 
pre-programmed video generation algorithms. 
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99. The method according to claim 96, wherein a video overlay operation is 
introduced into said video output signal. 



100. The method according to claim 96, wherein said real-time video processor 
2 generates said video output signal using a video wipe processing operation. 

101. The method according to claim 96, wherein said real-time video processor 
2 generates said video output signal using a video fade processing operation. 

102. The method according to claim 96, wherein said real-time video processor 
2 generates said video output signal using a video blend processing operation. 

103. The method according to claim 96, wherein said real-time video processor 
2 generates said video output signal using a video solarization processing operation. 

104. The method according to claim 96, wherein said real-time video processor 
2 generates said video output signal using a video geometric warping operation. 



105. A video camera control system comprising: 
2 an input interface for receiving incoming MIDI control signals; 

a camera for generating an outgoing video signal, said camera comprising at least one 
4 video capture control function; and 

a processor for generating camera control signals according to a video capture control 
6 algorithm controlled by said incoming MIDI control signals, wherein said camera control 

signals selectively control each function of said at least one video capture control function of 
8 said camera. 



106. The system according to claim 105, wherein said video capture control 
2 algorithm is selected from a plurality of pre-programmed video capture control algorithms. 
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107. The system according to claim 106, wherein an incoming control signal of 
MIDI format is used to select a particular video capture control algorithm from said plurality 
of pre-programmed video capture control algorithms. 

108. The system according to claim 105, wherein one function of said at least one 
video capture control function is a camera zoom function. 

109. The system according to claim 105, wherein one function of said at least one 
video capture control function is a camera pan function. 

1 10. The system according to claim 105, wherein one function of said at least one 
video capture control function is a camera tilt function. 

111. The system according to claim 105, wherein one function of said at least one 
video capture control function is a camera focus function. 

112. A method for controlling video camera system comprising: 
receiving incoming MIDI control signals; 

generating an outgoing video signal using a camera comprising at least one video 
capture control function; and 

generating camera control signals according to a video capture control algorithm 
controlled by said incoming MIDI control signals, wherein said camera control signals 
selectively control each function of said at least one video capture control function of said 
camera. 

113. The method according to claim 1 12, wherein said video capture control 
algorithm is selected from a plurality of pre-programmed video capture control algorithms. 
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1 14. The method according to claim 113, wherein an incoming control signal of 
MIDI format is used to select a particular video capture control algorithm from said plurality 
of pre-programmed video capture control algorithms. 

115. The method according to claim 1 12, wherein one function of said at least one 
video capture control function is a camera zoom function. 

116. The method according to claim 112, wherein one function of said at least one 
video capture control function is a camera pan function. 

117. The method according to claim 1 12, wherein one function of said at least one 
video capture control function is a camera tilt function. 

118. The method according to claim 112, wherein one function of said at least one 
video capture control function is a camera focus function. 
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